Staff  Summary  Sheet 


Action 

Signature  (Surname)*  Grade,  K  To 

A  Bate  U 

Action 

Signature  (Surname),  Grade,  Date 

1 

Col  Butler 

Approve 

o-(a 

6 

j 

2 

DFER 

Review 

(?cAr/?  , 

7 

tv 

3 

Dr.  Kwon 

Action 

c'fK 

J.J/WCH3 

8 

4 

9 

5 

1 

10 

Grade  and  Surname  of  Action  Officer 

Dr.  Hyukseong  Kwon 


jDFEC 


333-6279 


30  April  2013 


Subject 

Clearance  of  Material  for  Public  Release 


Case  Number:  >  /y  4FA  - ?Y  &> 


SSS  Date 

23  April  2013 


Summary 

1.  Purpose:  To  provide  security  and  policy  review  on  the  conference  paper  at  Tab  1  prior  to  release  to  the  pi  blic. 

: 

|2.  Background: 

-  Author  (s):  Hyukseong  Kwon,  Josiah  Yoder,  Stanley  Baek,  Scott  Gruber  and  Daniel  Pack 

L  Title :  “Max.tir.izin?.  Target  Detection  under  Sunlight  Reflection  on  Water  Surfaces  with  an  Autonomous  l/nmanned  Aerial  Vehicle 

Release  information :  Tc  publish  in  the  proceedings  of  the  2013  International  Conference  on  Umnanned.Aircraft  Systems,  Atlanta, 
GA 

-  Previous  clearance  information :  None 

i  -  Recommended  distribution  statement '  Distribution  A,  Approved  for  public  release,  distribution  unlimited^ 

13.  Recommend.:  tion:  Sign  coord  block  above  indicating  document  is  suitableTorpublic  release.  Suitability  is  based  solely  on  the 
;  document  being  inclassif'ed,  rot  jeopardizing  DoD  interests,  and  accurately  portraying  official  policy. 


Dr.  Hyukseong  Kwon 

Department  of  F’ectri  :s  1  f*nd  Computer  Engineering 

Tab 

1.  Copy  of  article 


AF  Form  176S,  Stiff  Summary 


Maximizing  Target  Detection  under  Sunlight  Reflection  on  Water 
Surfaces  with  an  Autonomous  Unmanned  Aerial  Vehicle 


Hyukseong  Kwon1,  Josiah  Yoder1,  Stanley  Back1,  Scott  Gruber1,  and  Daniel  Pack2 


Abstract —  Reflected  sunlight  can  significantly  impact  vision - 
based  object  detection  and  tracking  algorithms,  especially 
ones  based  on  an  aerial  platform  operating  over  a  marine 
environment.  Unmanned  aerial  systems  above  a  water  surface 
may  be  unable  tc  detect  objects  on  the  water  surface  due  to 
sunlight  glitter.  Although  the  area  affected  by  sunlight  reflection 
may  be  limited >  course  correction  of  unmanned  aerial  vehicles 
(UAVs)  -  especially  fixed- whig  UAVs  -  is  also  limited  during 
a  short  time  horizon,  making  it  challenging  to  determine  a 
reasonable  path  that  avoids  sunlight  reflection  while  maximising 
chances  to  capture  a  target.  In  this  paper,  we  propose  an 
approach  for  autonomous  UAV  path  planning  that  maximizes 
the  accuracy  of  the  estimated  target  location  by  minimizing  the 
sunlight  reflection  influences, 

I,  INTRODUCTION 

Autonomous  target  detection  and  tracking  are  two  of  the 
most  critical  capabilities  required  of  unmanned  aerial  ve¬ 
hicles  (UAVs),  and  provide  fundamental  building-blocks  for 
higher- level  algorithms  such  as  target  identification,  behavior 
recognition,  and  target  geo  location,  among  many  others.  In 
a  marine  environment,  one  of  the  major  challenges  to  target 
detection  and  tracking  is  the  presence  of  sunlight  (or  other 
light  sources)  reflected  on  the  water  surface,  making  target 
detection/tracking  much  more  problematic.  Not  only  does 
reflected  sunlight  distract  target  detection,  the  reflected  light 
can  distort  the  target's  visual  information  or  wash  it  out 
completely.  Figure  1  is  a  sample  image  presenting  sunlight 
reflection  on  water  surfaces. 

In  order  to  predict  where  sunlight  reflection  will  occur,  we 
use  a  bidirectional  reflection  distribution  function  (RRDF) 
[l].  The  RRDF  is  a  model  to  estimate  reflected  radiance 
using  four  different  elements:  azimuth  and  elevation  angles 
of  an  incident  light  ray,  and  azimuth  and  elevation  angles  of 
an  outgoing  light  ray.  In  the  ease  of  sunlight,  the  azimuth 
and  elevation  of  the  incident  light  can  be  predetermined 
based  upon  current  lighting  conditions  -  the  strongest  light 
will  come  in  from  only  one  direction.  However,  given  the 
roughness  of  the  ocean  surface,  the  outgoing  light  will 
be  scattered  in  many  directions.  The  RRDF  allows  us  to 
compute  the  strength  of  the  reflected  light  along  any  of  these 
directions. 

We  11 -accepted  RRDF  models  for  light  reflection  include 
the  Torrance -Sparrow  model  [2],  the  Phong  reflectance 
model  [3],  and  the  Oren-Nayar  model  [4],  Torrance  and 
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Fig,  i.  An  example  image  of  sunlight  reflection  on  water  surfaces 


Sparrow  proposed  a  reflection  model  for  a  roughened  surface 
consisting  of  v-shaped  specular  micro-facets  [2].  Based  on 
that  assumption,  they  provided  an  analytical  solution  to  ex¬ 
plain  off-peak  light  reflection.  Addressing  the  problem  from 
a  real-time  rendering  perspective,  Phong  proposed  a  simple 
three-component  model,  consisting  of  ambient  reflection, 
Lambertian  diffuse  reflection,  and  a  specular  component  [3]. 
Oren  and  Nayar  returned  to  the  physical  reflection  models, 
further  developing  the  approach  of  Torrance  and  Sparrow  to 
model  rough  surfaces  as  v-shaped  Lambertian  micro-facets 
and  computing  an  accurate  off-plane  reflection  model  (4], 
In  an  extension  of  their  work  with  Wolff,  they  included  the 
effect  of  subsurface  scattering  to  their  model  [5].  Sunlight 
glim  off  of  sea  surfaces  is  dominated  by  reflection  at  the 
water  surface,  Cox  and  Munk  emperically  demonstrated  that 
surface  roughness  is  linearly  correlated  with  wind  speed  [6]. 

Since  realistic  light-reflection  models  are  important,  we 
propose  a  variation  on  the  Oren  and  Nayar's  reflection  model 
that  includes  specular  components  and  diffuse  components. 
The  key  contribution  of  our  work  is  providing  a  mechanism 
for  light-reflection  avoidance  to  be  incorporated  into  the  UAV 
path  planning  process. 

There  is  a  significant  body  of  literature  on  UAV  path 
plaining  related  to  target  detection/ tracking.  Due  to  space 
limitations,  we  restrict  our  review  to  a  few  closely-related 
works,  focusing  in  particular  on  local  path  planning  for  fixed- 
wing  UAVs.  In  our  context,  local  path  planning  addresses  path 
decisions  made  to  effect  the  UAVs  short  term  path,  reserving 
the  term  global  path  planning  (not  covered  here)  with  col¬ 
lection  of  multiple  path  planning  steps.  Dobrokhodov  et  al 
suggested  a  small  UAV  system  which  is  capable  of  detecting 


and  tracking  a  mobile  target  on  the  ground  with  a  gimbaied 
camera  system  [7]-  In  order  to  compensate  for  brief  periods 
of  lost  detection s,  they  used  a  linear  parametrically  varying 
(LPV)  niter.  Theodorakopoulos  and  Lacroix  proposed  a 
method  using  a  lateral  guidance  law  that  adjusts  the  aircraft’s 
roll  angle  to  maintain  a  proper  target  view  angle  [8],  Quigley 
etal  designed  a  hierarchical  UAV  control  system  to  perform 
multiple  tasks;  target  detection,  localization,  and  surveillance 
[9],  Their  method  dealt  with  flight  path  planning  with  high- 
level  control  and  camera  gimbaling  with  low-level  control, 
Rafi  et  at  developed  a  single  follow -and -orb it  strategy  and 
demonstrated  in  simulations  that  it  kept  a  target  vehicle  in 
view'  despite  of  the  vehicle  moving  at  different  velocities 
while  making  turns  in  an  urban  environment  [10].  Their  work 
provided  a  circular  flight  path  strategy  considering  target 
speed*  UAV  airspeed,  and  UAV  maneuverability.  Finally, 
Skoglar  provided  a  good  review  of  the  UAV  path  planning 
literature  in  his  thesis  [11],  as  well  as  exploring  several 
directions  for  UAV  control  and  tracking  of  ground  targets. 

There  is  also  more  specific  literature  related  to  UAV 
path  control  considering  no-fly  zones.  Among  a  number  of 
publications,  Bellingham  et  ai  presented  a  receding  horizon 
control  to  optimize  a  UAV's  flight  trajectory  with  no-fly  zone 
constraints  [12],  Their  method  solved  a  modified  Mixed- 
Integer  Linear  Programming  problem  with  two  different 
functional  levels  of  trajectory  planning  algorithms,  Zen  gin 
and  Dogan  suggested  a  rule-based  flight  guidance  strategy 
in  the  situation  of  mobile  target  pursuit  [13].  Their  method 
considered  multiple  factors  of  restricted  region  avoidance, 
target  proximity  maintenance,  and  threat  exposure  level 
minimization.  In  order  to  deal  with  multiple  constraints, 
they  used  a  probaoilistic  threat  exposure  map  and  a  gradient 
search  algorithm.  Droge  and  Egerstedt  proposed  a  solution 
to  the  problem  of  flying  to  a  known  target  with  unknown 
obstacles  in  the  way  [14],  In  their  paper,  a  UAV  plans  its 
current  trajectory  based  on  obstacles  within  its  field  of  view, 
adaptively  changing  howr  far  it  looks  ahead  with  its  mode  I - 
predictive  control  based  on  recent  past  performance  of  the 
various  controllers. 

Differently  from  the  conventional  methods  mentioned  in 
the  above  paragraph,  wfe  do  not  deal  with  'no-fly'  zones, 
but  deal  with  4nori-preferred-fly*  zones  due  to  the  sunlight 
reflected  areas,  which  are  the  areas  that  we  would  like  to 
avoid.  However,  depending  on  location,  date,  time  of  day, 
the  size  and  position  of  the  area,  passing  through  a  non- 
preferred-fly  zone  could  be  the  best  decision.  Our  focus 
in  this  oaper  is  to  determine  a  UAV  path  or  trajectory 
that  minimizes  the  influence  caused  by  sun l ight-re fleeted 
background  areas  around  a  tracked  target  by  finding  a 
path  that  minimizes  target  detection  uncertainty.  Our  novel 
approach  proposes  a  UAV  path  planning  method  that  avoids 
sunlight  reflection  around  an  estimated  target  location  while 
maintaining  appropriate  UAV  motion  and  target  detection 
feasibility. 

The  ’emainder  of  the  paper  is  organized  as  follows: 
Section  II  describes  a  relative  geometry  model  with  sun, 
target,  sunlight  reflection  and  UAV  components.  In  this 


Fig.  2.  Illustration  of  UAV  motions  related  to  sunlight  reflection  near  a 
target  location 

section,  the  restricted  UAV  motion  model  effects  on  target 
detectability  near  sunlight  reflection  is  described.  Section 
HI  explains  the  setup  of  the  sunlight  reflection  model  that 
induces  sunlight  reflectance  along  UAV  paths.  Section  IV 
proposes  a  technique  for  finding  a  preferable  UAV  path 
considering  the  sunlight  reflection  model,  UAV  motion,  and 
uncertainty  of  estimated  target  location.  Finally,  simulation 
results  validate  our  approach  in  Section  V,  and  Section  VI 
concludes  the  paper, 

II,  UAV  Motion  Preference  with  Target 
Detection 

Throughout  this  paper,  we  define  a  sunlight  reflected  area 
as  an  area  where  a  UAV  cannot  see  the  target  due  to 
sunlight  reflection  over  the  target  location's  area  of  uncer¬ 
tainty  (see  Fig,  2).  Since  the  motion  of  a  fixed-wing  aircraft 
is  nonholonomic,  there  are  possible  situations  where  the 
UAV  needs  to  pass  through  target  nonvisible  areas  due  to 
sunlight  reflection  around  the  target  location  so  that  the  UAV 
maintains  an  appropriate  motion  or  distance  to  the  target. 
In  this  section,  we  present  how  to  define  a  UAV  motion 
preference  considering  the  UAV  avionics  and  target  detection 
using  an  image  sensor  for  a  fixed-wing  UAV.  In  our  current 
proposed  method,  the  UAV  motion  model  assumes  a  constant 
velocity.  Therefore,  the  UAV  model  can  be  simplified  as. 


X 

V'sin(y) 
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= 

v  ■  cos  ( tyr) 

Wdev 

where  x ,  y,  and  i ff  are  the  UAV's  jr-coordinate  value,  y- 
coordinate  value,  and  'yaw'  angle,  respectively.  And  v  is 
the  tangential  velocity  of  the  UAV  and  is  the  yaw  angle 
change  from  the  previous  estimation.  The  reference  axis  for 
tg  is  the  coordinate  axis  toward  north  (y-axis)  in  the  world 
coordinate  frame. 

The  basic  target  tracking  approach  used  in  this  paper  is 
shown  in  Fig,  2.  While  the  UAV  tracks  a  target  on  the 
water  surface,  a  certain  range  of  the  UAV's  path  can  be 
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Fig.  3*  Maximum  and  minimum  UAV  orbits  at  an  altitude  for  target 
detectability 

affected  by  sunlight  reflection.  The  target  is  located  under 
the  influence  of  sunlight  reflection  on  the  water  surface, 
which  produces  a  sunlight  reflected  area  with  camera  sensor 
systems  along  a  portion  of  the  UAV  orbits  around  the  target. 
As  mentioned  earlier,  the  goal  in  this  paper  is  to  find  the  UAV 
path  around  the  estimated  target  location  while  minimizing 
the  uncertainty  of  target  localization. 

Initially,  the  UAV  persistently  tracks  the  target,  which 
means  that  the  UAV  tries  to  maintain  a  circular  orbit  around 
the  target  in  order  to  have  consistent  target  detection  charac¬ 
teristics.  As  illustrated  in  Fig.  2,  depending  on  UAV  altitudes, 
the  pattern  of  sunlight  reflection  of  the  same  UAV  orbit  radius 
changes.  Besides  the  UAV  altitude,  different  orbit/bank  radii 
also  provide  different  target  detectability  as  shown  in  Fig,  3, 
As  depicted  in  Fig,  3,  once  a  certain  number  of  feasible  al¬ 
titude  candidates  a  selected,  for  each  altitude,  the  minimum 
and  maximum  orbit  radii  can  be  calculated.  The  minimum 
radius  is  restricted  by  the  maximum  UAV  bank  angle.  The 
minimum  orbital  radius  rmm  is  calculated  as 
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where  g  is  the  gravitational  acceleration  (9,8  m/s2),  and  <ftntax 
is  the  maximum  UAV  bank  angle  [15]. 

On  me  otner  n.  ad,  the  maximum  orbit  radius  rmax  is 
determined  by  the  maximum  distance  to  detect  a  target  with 
a  designated  sensor,  which  is  an  electro-optic  sensor  in  our 
approach.  With  die  maximally  allowable  distance-to-target  as 
dmtix  (according  to  sensor  capability),  the  maximum  orbital 
radius  r.nax  becomes 

rmax  —  4^  (3) 

where  hs  ;s  the  r:  altitude  candidate* 

In  cur  sensor  vs  ten,  target  detectability  is  inversely 
proporiiccal  to  trie  size  of  target  localization  uncertainty 
covariance.  In  order  to  compare  twe  different  covariance 
matrices  we  use  .races  of  covariances  hi  this  paper.  Since 
the  size  of  target  localization  uncertainty  is  proportional  to 
the  distance-to-target  and  the  elevation  angle-to-target,  rmin 
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Fig.  4,  Different  UAV  orbit  candidates  according  to  sunlight  reflection 
ranges 

with  the  lowest  UAV  altitude  provides  the  best  target  de¬ 
tectability*  However,  if  sunlight  reflected  areas  are  involved, 
any  candidate  orbit  can  be  the  best  one.  Figure  4  presents 
four  different  cases  where  the  target  non  visible  area  due  to 
sunlight  reflection  can  affect  an  orbital  radius  between  rmjn 
and  In  both  of  the  cases  shown  in  frames  (a)  and  (b), 
the  minimum  orbital  radius  will  be  the  best  choice  because  it 
gives  the  best  target  detectability  with  no  sunlight  reflection 
influence.  In  the  case  shown  in  frame  (c),  we  compare  the 
orbital  radius  just  outside  sunlight  reflected  areas  and  other 
radii  in  the  sunlight  reflected  areas.  Finally  in  the  case  shown 
in  frame  (d),  we  must  find  an  orbit  radius  with  some  minimal 
cost  since  sunlight  reflection  covers  all  possible  UAV  radii. 
Depending  on  the  distribution  of  sunlight  reflection,  a  certain 
path  in  the  thick  (red  in  colored  prints)  line  becomes  the  best 
path  in  the  cases  shown  in  frames  (c)  and  (d).  In  the  following 
section,  we  explain  how  to  determine  the  sunlight  reflected 
area  at  each  altitude  along  the  UAV  paths, 

III.  Diffuse  Sunlight  Reflection  Model 

In  order  to  calculate  accurate  sunlight  reflection  affected 
areas  according  to  target  locations  and  relative  UAV  posi¬ 
tions,  we  need  to  first  calculate  the  amount  of  sunlight  reflec¬ 
tion.  In  our  system,  we  assume  that  the  weather  condition  is 
consistent.  Therefore,  when  a  UAV  passes  a  sunlight  reflected 
area,  the  sunlight  reflected  pattern  has  not  changed  until  the 
UAV  revisits  the  area. 

Conceptually  speaking,  light  reflection  can  be  decom¬ 
posed  into  various  components:  specular  reflection,  diffuse 
reflection,  diffuse  back-scatter,  retrofiection,  and  ambient 
components,  to  name  a  few.  Since  this  paper  deals  with 
surface  target  perception  from  an  image  sensor  mounted 
on  a  UAV,  we  simplify  the  light  reflection  model  by  using 
two  major  factors,  specular  reflection  and  directional  diffuse 
reflection,  as  shown  in  Fig.  5. 

The  amount  of  directly  reflected  luminance  depends  on 
incident  azimuth/elevation  angles  of  sunlight  rays  to  the  wa¬ 
ter  surface  and  reflected  azimuth/elevation  angles*  Figure  6 
illustrates  a  general  light  reflection  with  incident/reflected 
sunlight  rays*  In  the  figure,  %  is  the  elevation  angle  of  the 
incident  light  with  respect  to  the  surface  norma),  and  is 
the  corresponding  azimuth  angle  with  respect  to  any  axis 
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Hg.  7,  Sampling  strategy  of  the  proposed  method 


Fig,  5 *  Proposed  sunlight  reflection  model 
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reflectance  component,  Lj?,  of  our  reflection  model  comes 
from  [4|,  obtained  through 
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Fig.  6,  Angles  of  mddent/nefleeied  light  rays 


Lf  (0r,  &i,  <pn  pi)  =  —  L,  cos  $ {Ci  +  C2  sin  a  tan  p 


where 


max{0,cos($r  —  pi  —  zr)}}  (6) 


Ci  =  1  —0.5 


C2  =0.45- 


o2  +  0.33 7 


a2  +  0.09 1 
a  —  raax(ft,0r), 


(7) 

(8) 

(9) 


on  the  ground  coordinate  frame  (e.g.  the  x-axis  or  y~axis)* 
The  reflected  elevation  and  azimuth  angles  (6r  and  pri  resp.) 
depend  on  the  location  of  the  UAV.  Our  model  is  based  on 
Oren-Nayars  model  [4],  adjusted  to  include  specu  lari  ties. 
Equations  4  and  6  describe  specular  reflectance,  Lf,  and 
directional  diffuse  reflectance,  L in  our  light  reflection 
model  respec;iveiy. 


and 

j}  ==  min  (0/A)*  (10) 

where  cr  is  the  roughness  of  the  surface*  Finally,  the  total 
light  reflectance,  Lr,  for  each  surface  region  with  a  certain 
perspective  becomes, 

Lr  ( 0r ,  ^i7  pn  Pi )  ~  bf  Prt  Pi)  4-  Lr  (0r,  0/,  pr  >  pi)  •  (11) 


Ll  ( 0, .  0/ » <Pr j  Pi)  —  ^ Lf  cos  Bj  *  <3U  ( By  —  Bi ,  pr  ~  Pi  ~  tt)  (4) 

where  p  is  albedo,  b\  is  the  incident  sunlight  strength, 
and  3w  U\y)  is  a  cylinder-like  function  with  the  following 
property. 


<%{0,p'\ 


1.  if  |0|<  0^  and  \p\<prh 
0,  otherwise 


(5) 


where  0^  is  the  threshold  of  elevation  angular  deviation  and 
pt h  is  the  threshold  of  azimuth  angular  deviation  between 
the  incident  light  and  the  corresponding  reflected  light*  If 
the  angular  deviation  is  larger  than  a  certain  threshold,  we 
can  consider  that  the  view  or  target  detection  is  not  affected 
by  the  sunlight  reflection.  Although  specular  reflection  is 
the  most  influential  part  on  an  ideal  flat  water  surface,  it 
affects  a  very  narrow  range  of  reflection  angles*  However  in 
practical  cases,  some  conditions,  sucli  as  roughness1  of  the 
water  surface,  make  the  affected  region  wider.  The  diffuse 


“We  assume  that  a  n  ugh  estimate  of  the  target’s  location  is  available, 
either  from  another  sensing  platform,  or,  m  the  case  of  tracking,  from  a 
previous  observation. 


Based  on  the  light  reflection  mentioned  above,  we  can 
consider  the  following  situation*  Suppose  that  we  have  an 
estimated  location  of  a  target  from  another  sensor  platform, 
and  that  the  UAV  is  approaching  this  location  (or  alterna¬ 
tively  that  the  UAV  is  in  the  middle  of  tracking  the  target)* 
To  model  sunlight  reflected  area  around  the  target's  loca¬ 
tion  on  the  water  surface,  we  sample  the  sunlight  reflected 
area  on  the  water  surface  with  S  =  {$Xiy}  as  shown  in  Fig.  7. 
And  to  plan  the  corresponding  UAV’s  trajectory,  we  also 
sample  the  feasible  area  with  U  =  {E/P  j}.  U  contains  expected 
sunlight  reflected  areas  on  UAVs  paths,  which  cover  between 
rmin  and  rmax.  Eventually,  the  search  region  is  determined 
by  a  combination  of  feasible  UAV  paths,  the  estimated 
target  location,  and  sun  orientation*  How  to  determine  the 
candidates  of  the  UAV  paths  to  avoid  sunlight  reflection  was 
already  described  in  Section  II. 

Finally,  at  each  sampled  cell,  Ujjt  the  predicted  light 
reflectance  bRef  is  calculated  as, 

Uef  (■ Uij )  =  (Uij  I  Sv)  (12) 

X  y 

where  LRef(Uij  \  SXty)  is  light  reflectance  from  SXy  to  Uij * 


y  -ISO  0 

(b)  Thresholded  distribution 
Fig.  fL  Sunlight  reflectance  over  the  sampled  area 


As  already  represented  in  Fig*  1,  if  the  target  is  in  the 
area  of  full  saturation  of  sunlight  reflection  or  in  a  partially 
reflected  area,  it  is  difficult  to  detect  small  targets.  Therefore, 
if  LfafiUij)  is  more  than  a  threshold  (obtained  from  exper¬ 
iments  and  the  corresponding  image  analysis),  we  consider 
Uij  as  a  'Target-Detection-Impossible-Section  T  Figure  8(a) 
shows  a  sample  of  sunlight  reflectance  distribution  over 
the  sample  area,  U,  and  Fig.  8(b)  shows  the  corresponding 
thresholding  from  Fig.  8(a). 

IV*  Integrated  UAV  Path  Planning 

By  us  ;:g  info  rmation  defined  in  Section  II  and  Section 
III,  we  can  define  ;  ne  best  UAV  path  to  minimize  target  lo- 
calLzadcu  uncertainty.  First,  we  define  the  target  localization 
uncertainty.  When  he  UAV’s  sensor  has  a  target  in  its  field 
of  view,  ihe  UAV  can  localize  the  target  with  localization 
uncertainly  as  shewn  in  Fig,  9,  The  uncertainty  a  in  the 
sense,  view  induces  the  uncertainty  E  around  the  target  on 
the  waier  surface* 

If  we  set  uncertainty  in  the  sensor  view  as  a  circle  with 
radius  <x.  the  uncertainty  £  becomes  an  ellipse.  We  define 
the  length  of  the  major  axis  of  the  ellipse  as  A^,  that  of 
the  rrfnor  axis  as  WfI?  the  corresponding  eigenvector  to  Xmax 


as  vmaxt  and  the  corresponding  eigenvector  to  Xmin  as  vmin. 
Then,  the  covariance  matrix  E  will  be 


Z  —  V 


Xmax  0 
0  Xmin 


VT 


(13) 


where  V  —  [  vm ^  Vmitt  ] . 

After  we  initialize  the  uncertainty  £,  each  additional 
observation  generates  a  measurement  uncertainty  Zmeas  for 
the  same  target  with  the  same  approach.  Then  the  updated 
uncertainty  Zup^ated  becomes 


^updated  =  [I~‘  +Emy  1  (14) 

Or  due  to  sunlight  reflection,  if  the  UAV  loses  track 
of  a  target,  the  uncertainty  increases  with  target  motion 
uncertainty  value  A*. 


^updated  ^ 


Xmax  +  Xt  0 

0  Xmin  +  Xt 


(15) 


Along  the  selected  paths  shown  in  Section  II,  we  calculate 
cumulative  covariance  changes.  Then  we  select  the  path 
which  indicates  the  smallest  peak  covariance  or  the  smallest 
average  covariance.  If  the  mission  goal  is  to  limit  the 
covariance  as  much  as  possible,  we  choose  the  smallest  peak 
covariance.  On  the  other  hand,  if  the  mission  goal  is  to  have  a 
more  accurate  target  localization  on  average  during  the  whole 
orbit,  the  smallest  average  covariance  should  be  considered. 

The  summary  of  the  proposed  method  is  shown  in  Algo¬ 
rithm  1. 


v.  Simulation  Results 

In  this  simulation  to  track  a  stationary  target,  we  used  the 
following  parameters: 

•  Target  location:  37°23r35*63”N,  124°  15’34.57”W  (Near 
San  Francisco  Bay) 

-  UAV  altitude:  125  -  175  m 

•  UAV  velocity:  20  m/s 

•  UAV  maximum  bank  angle:  18° 

•  Sensor  frame  rate:  5  frames/sec 

•  Date:  March  15,  2013 


Algorithm  1  Proposed  algorithm 

Determine  S  around  the  estimated  target  location. 
Determine  candidates  of  feasible  UAV  altitudes, 
for  each  UAV  altitude 
Find  rmit:  and  rmax. 

Determine  the  sunlight  reflection  area  U. 
end 

for  each  x,y 

Estimate  Lx(UXJ). 
end 

Threshold 

for  each  UAV  altitude 
for  each  UAV  path 

Estimate  Fs  along  each  UAV  path, 
end 
end 

Choose  the  optimal  UAV  path. 


With  the  attitude  choices  of  125  m,  150  m,  and  175  m 
above  set  leve;,  and  the  lime  around  12:00  PM  {azimuth  of 
sun  is  1 73,12  degrees  and  its  elevation  is  50.21  degrees), 
the  path  candidates  are  shown  in  Fig,  10(a)  through  (c). 
The  circular  contours  are  UAV  path  candidates  and  irregular 
contours  (in  magenta  in  colored  prints)  are  the  sunlight 
reflected  areas.  Solid  line  paths  (in  blue  in  colored  prints) 
are  non-op timal  lav  paths,  and  the  path  writh  o-symbols  (in 
red  in  colored  prints)  is  the  optimal  path  chosen  whth  the 
proposes  criteria.  The  locations  of  o- symbol  show  the  point 
where  the  image  is  taker. 

In  or. nr  n  de  „i  the  change  of  sunlight  reflection  and 
its  relate  UAV  p.  h  change.  Figures  11  through  14  show 
simul  or  result-  for  different  times.  Figure  I  1(a)  shows  a 
three  c.i m^nsiona,  visualization  of  the  UAV  path  candidates 
with  the  carresp  v  ding  sunlight  reflection  areas.  The  path 
with  c -symbols  :s  :he  optimal  path  which  is  chosen  when 
it  is  10:79  AM  ru.dmuth:  133.22°,  elevation:  39.21°).  Fig. 

1 1  (b)  shows  t.  comparison  of  covariance  changes  for  each 
UAV  path  For  a  be: ter  view  of  the  covariance  changes,  each 
value  is  shown  as  he  log- values  of  the  traces  of  covariance 
matrices  The  thick  solid  line  (in  red  in  colored  prints) 
shows  dm  opt  mal  -undulate  and  the  dashed  lines  show  other 
candidates.  Fg.  T  Fig,  13,  and  Fig.  14  show  results  at 
12:00  PM  (azimuth;  H3  12°,  elevation:  50,21°),  2:00  PM 
(azimuth:  216.83°,  elevation:  43,91°),  and  4:00  PM  (azimuth: 
245 . 8 3C  e '  e vat  i  on  *  25.33°),  re  specti  ve  1  y.  Readers  ca  n  see  that 
the  high-  "  elevat  on  of  the  sun  provides  the  wider  sunlight 
reflected  area  near  the  estimate  target  location,  which  results 
in  the  more  comp: mated  path  selection, 

TABLES  7  through  TV  show  quantified  results  of  the 
number  of  frame  ha*  lost  track  of  the  target,  the  average 
distar cf:  -a- tr  get  the  average  elevator  angle  to  the  target 
from  the  UAV.  ann  ;he  maximum  trace  of  covariance  in  rela¬ 
tion  to  ti;u  UA W  hitude  and  orbital  radius.  The  candidates 
marked  with  -  snow'  the  optimal  choice  with  the  smallest 
maxi  mure  trace  of  covariance  (bold  fonts  ). 


(a)  At  125  m  altkude 


-ISO  -100  -50  0  So  100  ISO 

x£m> 


(b)  At  1  SO  m  altitude 


(c)  At  175  m  altitude 

Fig,  10.  UAV  path  candidates  for  each  altitude  at  12:00PM 


TABLE  I 

Simulation  test  result  for  10:00AM 


Altitude 

(m) 

Orbital 

radius 

(m) 

Target 

loss 

(frames) 

Distance 
to  target 
(m) 

Elevation 
to  target 

o 

Maximum 
trace  of 
covariauce 

*  1 25,0 

1 19.6 

0 

1710 

46.28 

18.99 

150.0 

119.6 

0 

191.8 

5L44 

19,92 

175.0 

1 19.6 

0 

211.9 

55,66 

21.21 

(a)  WAV  paths 


(a)  UAV  paths 


(b)  Covariances  over  time 
Fig.  11.  Result  for  time  10:00AM 


(b)  Covariances  over  time 
Fig,  12.  Result  for  time  12:00PM 


TABLE  11 

Simulation  test  result  for  1 2:00PM 


Altitude 

(m) 

1  Orbital  |  Target 

5  radius  j  loss 

1  i,m)  |  (frames) 

Distance 
to  target 
(m) 

Elevation 
to  target 

n 

Maximum 
trace  of 
covariance 

125.0 

I  1 16.8  T  8 

171,1 

46.93 

197.28 

125.0 

126.8  |  5 

178.1 

44.57  1 

139,95 

*125  0 

i  156,9  |  (1 

135.4 

42.39 

21.41 

150. 1 

'  116.8  8 

190.1 

52.08 

199.26 

150.) 

\  126.8  8 

196.4 

49.77 

201,50 

150.0 

;  156,9  F  8 

203.1 

47.60 

203,91 

150  J 

147,1  !  9 

210.0 

45.55 

226,54 

150J 

|  157.1  0 

i  217.2 

43,66 

24.65 

175.0 

1 16.8  .  5 

210.4 

56.27 

141.91 

175.0 

1 2^  8  8 

216.1 

1  5405 

203,85 

175.0 

]  36,9  9 

222,2 

51.95 

225.94 

175.0 

147,1  9 

228.6 

49.94 

228.20 

1 75.0 

157.1  ■  9 

■  255,2 

!  48.07 

230.59 

175.0 

16/. 2  10 

242,0 

4630 

253.13 

VI.  Conclusion 

In  this  paper,  we  presented  an  approach  for  UAV  path 
planning  Urn  mi  Tizcs  target  detection  feasibility  while 
mining;  g  sunlig.u  reflection.  Ir,  order  to  estimate  sunlight 
reflection,  we  used  our  customized  light  reflection  model 


TABLE  01 

Simulation  test  result  for  2: 00 PM 


Altitude 

(m) 

Orbital 

radius 

(m) 

Target 

loss 

,  (frames) 

Distance 

to  target 
(m) 

Elevation 

to  target 

O 

Maximum 

trace  of 
covariance 

125.0 

120.0 

7 

173.2 

46,16 

178.10 

125.0 

132.2 

7 

181.9 

43.39 

181,44 

125,0 

145.0 

8 

191,4 

40,76 

205.29 

125.0 

157.2 

6 

200,8 

38,49 

169,29 

125.0 

170,0 

0 

~  211.0 

36.32 

26,91 

*150.0 

120.0 

0 

192.0 

5L34 

19.97 

175.0 

120.0 

0 

212.1 

55.56 

21.25 

TABLE  IV 

Simulation  test  result  for  4:00PM 


Altitude 

(m) 

Orbital 

radius 

(m) 

Target 

loss 

(frames) 

Distance 

to  target 
(m) 

Elevation 

to  target 

O 

Maximum 
trace  of 
covariance 

*125,0 

119.5 

0 

172,9 

46.28 

18.99 

150,0 

1 19,5 

0 

191.8 

51.45 

19.92 

175.0 

119,5 

0 

21  L9 

55.67 

21.21 

containing  specular  and  directional  diffuse  reflectances,  and 
sampled  sunlight  reflected  regions  near  the  estimated  target 
location  and  the  corresponding  areas  along  UAV  paths.  In 


100. 


300, 


2  50 , 

2C0, 
1  'dO, 
.00, 
SO, 
0. 

-200 


Kim)  y(m) 

(a)  UAV  paths 


(b)  Covariances  over  lime 
Fig  1 3,  Result  for  time  2:00PM 


order  :c  rind  ,he  best  UAV  path,  we  estimated  target  lo¬ 
calization  uncertainty  covariances  along  feasible  UAV  paths 
considering  target  detectability,  and  found  the  path  which 
presented  the  smallest  peak  covariance  or  average  covariance 
depending  on  the  mission  requirement.  Simulation  tests 
validated  our  approach.  Future  work  includes  a  path  planning 
approach  with  mobile  target  tracking  and  a  sunlight  reflected 
area  compensation  using  computer  vision  techniques, 
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